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Abstract — This paper aims at understanding a different route to 
Artificial Intelligence (AI), i.e. Brain -Inspired AI based on deep 
learning movement which involves building artificial neural 
networks, which mimic the behavior of the human brain. 
Artificial neurons are the building blocks of artificial neural 
network. To fulfill this goal the paper starts with building a 
mathematical Model of a single neuron by making analogy 
between biological and electrical components. Then the 
analogous electrical circuit is expressed in terms of differential 
equation and simulated using MATLAB to study various 
characteristics. Then one of the simplest single neuron model, 
the Integrate and Fire model is discussed and simulated. Various 
affords were made to make the model more realistic. Finally, the 
Hodgkin and Huxley model which very closely approximate a 
real biological neuron is discussed and simulated using 
MATLAB. The results shows that step by step the single 
neurons models closely approximate the behavior of the 
biological neuron which is the building block of artificial neural 
network. 


Index Terms — Artificial Intelligence, Artificial Neuron, IF 
model, HH model, Differential equation, MATLAB. 


I. INTRODUCTION 

The science and engineering of making intelligent machines, 
that mimics the way humans think, feel, move and make 
decisions is called Artificial Intelligence (AI)[1]. In the early 
days,AI engineers believed that, they would have to build and 
combine thousands of individual computing algorithm. One 
algorithm, would mimic language, another would mimic 
speech and so on.But there's a theory that human intelligence 
stems from a single algorithm which arises 
from experiments suggesting that the portion of the brain 
which process sound from ears can also handle sight for eyes, 
which is possible only when brain is in the earliest stage of 
development. In this way brain can be thought of at its core a 
general-purpose machine that can be tuned to specific tasks. 
These leads a new field of AI research known as Deep 
Learning, which involves building neural networks, that 
mimic the behavior of the human brain. Artificial neurons are 
the building blocks of artificial neural network.This 
movement seeks to meld AI with neuroscience. [2] The 
scientific study of the nervous system is known as 
Neuroscience., Neuroscience was thought of as a branch of 
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biology,traditionally.Currently however, it is an 
interdisciplinary science that collaborates with other fields 
such as, computer science, engineering, linguistics, 
mathematics, medicine, chemistry, philosophy, physics, and 
psychology. Inclusion of different approaches used to study 
the molecular, cellular, developmental, structural, functional, 
evolutionary, computational, and medical aspects of the 
nervous system has broadened the scope of neuroscience. [3] 

II. NEURON 

The basic building blocks of the nervous system are Neurons. 
These specialized cells are known as the information 
processing units of the brain, as they receives processes and 
transmits information. There are three main structures in a 
typical neuron- 

a. The cell body -it directs all activities of the neuron, 

b. Dendrites -it extend out from the cell body and 

receive messages from other neurons, and 

c. Axon -a long single fiber ,it transmits messages from 

the cell body to the dendrites of other neurons or to 
other body tissues. 



Fig. 1 Structure of a typical neuron . 
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III. NEURAL SIGNALING 

An electrochemical signal known as action potential (AP) is 
through which the neurons communicate. [4]The difference in 
concentration of ions between the inside and outside of the 
membrane.is the cause of AP. The Na+ and K+ are the 
dominating ions . Without any externally applied stimulus the 
equilibrium membrane potential is -70mv which is known as 
the resting membrane potential.The membrane is composed 
of lipid bilayer which is impermeable to any charged particle 
and protein pore only through which ions can pass. This pores 
are called ion channels which are guarded by special 
molecules called gatekeepers which open and close 
depending on certain conditions. 


O o 
o o 




Fig. 2 Small section of the biological neuron membrane. 


There are different ion channels for different types of ions. A 
stimulus from a sensory cell or another neuron depolarizes the 
target neuron to its threshold potential (-55 mV), and Na + 
channels in the axon hillock open, starting an action potential. 
Once the sodium channels open, the neuron completely 
depolarizes to a membrane potential of about +40 mV. The 
action potential travels down the neuron as Na+ channels 
open. As soon as depolarization is complete, the cell "resets" 
its membrane voltage back to the resting potential. The Na + 
channels close, beginning the neuron's refractory period. At 
the same time, voltage-gated K + channels open, allowing K + 
to leave the cell. As K + ions leave the cell, the membrane 
potential once again becomes negative. The diffusion of K + 
out of the cell hyperpolarizes the cell, making the membrane 
potential more negative than the cell's normal resting 
potential. At this point, the sodium channels return to their 
resting state, ready to open again if the membrane potential 
again exceeds the threshold potential. Eventually, the extra K + 
ions diffuse out of the cell through the potassium leakage 
channels, bringing the cell from its hyperpolarized state back 
to its resting membrane potential[.5] This sequence of events 
occurs in a local area of the membrane,but these changes get 
passed on to the next area of membrane, then to the next area, 
and so on to the entire length of the axon. Thus, the action 
potential gets transmitted down the nerve cell. [6] 



Lig. 3 An action potential with its different states caused by 
the sodium and potassium channels” kinetics. 


Both excitatory and inhibitory inputs from multiple neurons, 
can be received in a single neuron and added together at the 
axon hillock. The neuron will fire, If the EPSPs are strong 
enough to overcome the IPSPs and reach the threshold of 
excitation,. [5] 



Fig. 4 Signal summation at the axon hillock. 


Like FM radio, information is encoded by the frequency of 
action potentials. A low frequency train of a few action 
potentials will be initiated by a small stimulus. The frequency 
of action potentials increases as the intensity of the stimulus 
increases. [6] 


IV. ELECTRICAL ANALOGY OF THE BIOLOGICAL 
NEURON 

We can make an electrical analogy of the biological neuronal 
membrane by representing the lipid bilayer which are 
impermeable to charged particles as the capacitor(C), the 
protein pores which allows passage of charge through them as 
the resistors (R,reciprocal of conductors) and the synaptic 
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input as the current injection (I in ). Now if we insert an 
electrode through the membrane and then inject current into 
the inside of the cell, this current will pass out of the cell 
through the resistor or the capacitor (through the pores or via 
the capacitance). Once the current reaches the outside of the 
cell it will disperse to the rest of the body and the surrounding 
world. In the diagram this is represented by the ground 
symbol. Now according to the Kirchhoffs law this can be 
mathematically expressed as: 

Iin = I C +lR (1) 


At every step, V + will be updated according to this rule and t+ 
will be updated by At. So the update for the full simulation 
requires equations for updating both t and V: 

t = t + 0:001 (5) 

V = 0:999. V + 0:001 (6) 

Now we can construct MATLAB code for this model and 
simulate (tb)observe various characteristics 


pore 

(resistor) 



Fig. 5 RC circuit analogy of the biological neuron membrane. 
I in is a known number,.I c and I R can be re-expressed using the 
current-voltage equations for capacitance and resistance. 
Therefore: 

Iin = C.AV/At+ g. V (2) 

Setting At to an infinitesimal value, this equation is called a 
differential equation,which can be solved using a numerical 
integration, getting very close to the analytically solution by 
making At very small. By using finite numbers and finite time 
steps, a discrete approximation to the differential equation can 
be created. By setting At = 1 ps = 0:001 ms = 1 .1 O' 6 s. AV can 
be expanded out as a difference: V + - V.Substituting for AV 
leaves us with: 

Iin - C .(V + -V)/At+ g . V 
Iin = v + (C/At)+ V (C/At)+ g. V 

V + = (1 - At .g/C) V + At(I in /C) (3) 

This is an update equation, The voltage (V +) is updated at 
each time step based on the previous voltage V. At the same 
time, time, t, is updated by simply adding At: t+ = t + At. The 
new voltage then becomes the V and the new time the t for the 
next update step. 

By setting g = 1 ms/cm 2 and C = 1 pF/cmUsing the chosen 
values, g/C = l/ms. Similarly, we will set the injected current 
to 1 p A/cm 2 so that I in /C = 1 mV/ms. We’ll set At = 0:001 ms. 
With these convenient choices, the update equation is: 

V + = (1- 0:001) V + 0:001 (4) 



Fig. 6 Plot of membrane potential vs. time for constant current 
input. I = 10nA,C = 0.1 nF ,R = 100 M-ohms, Time constant, 
RC=10 ms. 


Now if we change the value of R and C and run simulations 
we observe that the membrane potential reaches a stable value 
slowly as we increase only R and quickly as we reduce the 
value of C only. When we change these together the 
membrane potential reaches a stable value quicker than the 
initial condition. We can also calculate the value of time 
constant t mem b that is the time needed for the membrane 
potential to reach 63% of its final value which is given by 
tmemb = g/C = RC.Time constant is a measure of the 
” stickiness” of the update equation dependent on how close 
the coefficient for voltage is to 1 . A bigger C/g (bigger RC) 
will make the coefficient closer to 1 causing the voltage to rise 
slower. [7] 

Now as we have made an electrical analogy of the neuron 
membrane we can implement various mathematical neuron 
model using MATLAB. A number of single neuron models 
are available since the early twentieth century. 


V. THE INTEGRATE AND FIRE MODEL (IF) 

One of the earliest single neuron model proposed by Louis 
Lapicque in 1907,is the Integrate and Fire model .This is one 
of the most popular single neuron models that still widely 
used today due to its simplicity.In the equivalent circuit 
membrane capacitance C and membrane resistance R. V is the 
membrane potential, V rest is the resting membrane potential, 
and I is the injected current. 
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Fig.7 The equivalent circuit of IF model. 

This can be mathematically expressed as- 
if V(t) > V th and — (t)> 0 M (7) 

Where f is called the firing time of the neuron and V th is the 
threshold voltage. [4] 

This model implies that the neuron fires only when the 
membrane potential V(t) reaches a certain value called the 
threshold potential V th .Now we can simulate the model using 
MATLAB and obtain the following results by varying input 
current from vary small to large values. 



Fig. 8 An integrate-and-fire model neuron driven by input 
current I=lnA and the threshold voltage Vth=10mv,i.e;the 
neuron only fires when the membrane potential exceeds 
lOmv. 



Fig. 9 When 1=2.5 InA the membrane potential V=10mv 
which is just equal to the threshold ,thus the neuron does not 
fire. 


50 -1-1-1-1-1-1-1-1-r 

45 -T-1-t -1-r-1-1- -I -r 

40-1-1-1-1-t -1-r-1-r 


35 



time ,t(m=.) 


Fig. 10 When I=2.52nA,the membrane potential is slightly 
more positive than the threshold and the neuron fires..The 
action potential reaches the peak amplitude which is 50mv in 
this case and then hyperpolarizes to3mv.The firing frequency 


is 5.10Hz. 



Fig. 11 When the input current I is further increased ,i.e, 
I=5nA firingfrequency further increased which is 31.25Hz 
now. The firing frequency keep increasing with input current 
and finally become fixed at 220Hz. When input current 
1=10. InA.After that inspite of increasing the input current 
firing frequency does not increase. This is the maximum firing 
frequency of the neuron. 

From the above simulations we observe that when the input 
current is increased from very low value the membrane 
potential starts increasing but the neuron does not fire until the 
membrane potential exceeds the threshold potential. As we 
further increase the input current the firing frequency 
increases until the maximum frequency is achieved. When 
the maximum firing frequency is reached the frequency does 
not increase in spite of increasing the input current. But the 
firing frequency can be further increased if we increase the 
absolute refractory period i.e, is the interval during which a 
second action potential absolutely cannot be initiated, no 
matter how large a stimulus is applied. [8] Biological spike 
trains look noisy. Noise interferes with frequency estimation. 
Thus it is necessary to smooth out the noise by signal 
averaging. This spiking irregularity may actually be some 
kind of uninterrupted signal that is being used by neurons in 
their calculations. This speculation is the province of an 
entirely different class of models (e.g., synchronization 
models). Following simulation shows integrate and fire model 
with noise. 
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Fig. 12 Integrate and fire model with noise. 


Artificial current injections from electrodes are square. But 
real biological signals are curvy. The alpha function is 
popular model for a PSP. The alpha function is parameterized 
as 

I = I — (8) 

A in -'-max e V°/ 

This is a complicated equation that produces a simple curve as 
shown in Figure-13. It rises quickly for time and then falls 
slowly over about 5 (a little slower than exponentially).[7] 
Thus we made an effort to make the above model more 
realistic by using alpha function as input current. Figure-14 
shows the input and output spikes in an integrate and fire 
model using alpha function. 



Fig. 13 Alpha Function. 
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Fig. 14 Input and output spikes in an Integrate and fire model 
using alpha function. 


VI. THE HODGKIN AND HUXLEY MODEL (HH) 

A neuron is not as simple as described by the Integrate and 
fire model. A more realistic model was proposed by Hodgkin 
and Huxley in 1952. Considering the equivalent electrical 
circuit shown in Figure-15, the electrical properties of a 
segment of nerve membrane can be modeled using: capacitors 
to model the charge storage capacity of the cell membrane, 
resistors: to model the various types of ion channels 
embedded in membrane, and batteries: to represent the 
electrochemical potentials established by differing intra and 
extracellular ion concentrations.[4]Unlike the previous IF 
mode HH model consider the resting membrane potential to 
be -70mv and also takes into account of opening and closing 
of various ion channels which make it more realistic then the 
IF model. Hodgkin and Huxley also had an implicit view of 
the functionality of switches controlling the ion channels. 
They called these switches particles. Both the sodium and the 
potassium channel were described as having four particles. In 
the case of the potassium channel, each of the four particles 
behaves identically. Each of these potassium particles is 
called n. Mathematically, the presence of four particles per 
channel is denoted by a multiplication: n. n . n . n = n 4 . In the 
case of the sodium channel there are 3 m particles and one h 
particle, giving m 3 .h [7]. 





Fig. 15 Equivalent circuit of HH model. 


V 


The general form of the mother equation of the Hodgkin- 
Huxley model can be written as: 

C m ~p=I s ti m .gjVQ.m 3 .h(V m -E Na )-g/f.n 4 (V m -E k )-g L (V m -E L ) 

(9) 

where C m is the membrane capacitance,V m is the intracellular 
potential (membrane potential),I stim is an externally applied 
current., gA r c is the maximum sodium conductance ,E Na is 
the sodium reversal potential calculated using Nerst-Einstien 
relationship, g L is the maximum leakage conductance per unit 
area and E L is the reversal leakage potential m,n and h are the 
three gating variables.[4] 

Now if we simulate the model using MATLAB we get the 
following results. By applying a significantly large current 
stimulus at one point in the membrane with a magnitude of a 
few milliamps and duration of several milliseconds, an action 
potential arises.lt depolarizes to a maximum value then the 
action potential repolarizes i.e reverts back to the negative 
direction.lt keeps repolarizing and hyperpolarizes below the 
membrane’s resting potential. (-60mv in this 
simulation).Finaly depolarizes to the resting membrane 
potential.These sequence of events are shown in the 
simulations below at several instant of time from the initiation 
of the action potential.. 
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Fig. 16 Propagation of the Action potential 1.69ms after the 
application of the stimulus. 
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Fig. 17 Propagation of the Action potential 2.05 ms after the 
application of the stimulus. 


Action Potential Propagation (20 degrees Celsius) 



Distance into Membrane (Millimeters) 

Fig. 18 Propagation of the Action potential 3.44ms after the 
application of the stimulus. 


Action Potential Propagation (20 degrees Celsius) 



Distance into Membrane (Millimeters) 

Fig. 19 Propagation of the Action potential 8ms after the 
application of the stimulus. 

In the above simulations we have shown the propagation of 
the action potential through the axon for 8ms. we observed 
that the membrane potential raises from a negative resting 
potential of -60mv towards a positive value and reverts back 
in the negative direction and becomes more negative than the 
resting membrane potential and finally retain the resting 
potential at the end. 

It also makes sense to check if the conductances match the 
plots shown above. A plot of the time versus the gate 
probabilities is given below. 



Fig. 20 Getting variables vs. time. 


When the stimulus is present, since , gA r c- is much more 
dependent on m than on h, it shoots up, which describes the 
peak of the action potential. As m increases, n increases as 
well, which peaks as m shoots back down; this describes the 
undershoot of the action potential. Graphically, this picture 
makes sense. 

Now if we increase the current injection from small to large 
value the firing frequency increases as shown in Fig. 21 
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Inject = 6.00 iuA/cm 2 Inject = 10.00 luA/cm 2 




Inject = 15.00 gA/cm 2 Inject = 20.00 gA/cm 2 




Fig. 21 Firing frequency increases with the input current 
injection. 

We know that information is encoded by the frequency of 
action potentials, much like FM radio . A small stimulus will 
initiate a low frequency train of a few action potentials. As the 
intensity of the stimulus increases, so does the frequency of 
action potentials, which is consistent with the above 
simulation. 

Thus we can say that we have successfully demonstrated the 
behavior of a neuron by electrical analogy i.e., an artificial 
neuron which is the building block of artificial neural 
network. 


VII. CONCLUSION 

Throughout the above discussion it is observed that an afford 
was made to construct an artificial neuron which is the 
building block of artificial neural network. Introduction was 
made by making analogy between a simple neuron membrane 
and RC network and results of simulation yields that its 
behavior is the same that of a RC network. Then one of the 
simplest neuron model the IF model which consider the 
neuron membrane as an RC network and synaptic input as 
current injection is discussed and simulated. The model was 
made more realistic by using alpha functions as current 
injection and addition of noise. But a neuron is not as simple 
as IF model. Thus a more realistic model, the HH model 
which closely approximate the behavior of a biological 
neuron by modeling the behavior of the action potential and 
gating variables was discussed and simulated to study various 
characteristics. It was observed that the behavior of the 
neuron described by the model closely approximated by the 
behavior of the biological neuron. Thus it can be said that the 
paper successfully described the behavior of an artificial 
neuron which is the building block of artificial neural 
network, i.e. a successful afford was made towards the 
introduction of brain inspired AI. 
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